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(54) METHOD FOR EXTRACTING KEY FRAME OF VIDEO SEQUENCE KEY FRAME 
EXTRACTING DEVICE FOR VIDEO SEQUENCE, STORAGE MEDIUM AND PROGRAM 
SOFTWARE 

(57)Abstract 

PROBLEM TO BE SOLVED: To substantially eliminate one or ^ 
more defects of an existing configuration or to at least 
improve the defect 

SOLUTION: The method for extracting a key frame from a 
video sequence consisting of MPEG-compressed video data 
having a block motion vector, includes a step (104) where the 
MPEG-compressed video data are received, a step (106) 
where the received data are partially decompressed to 
acquire a block motion vector, and the block motion vector is 
converted into a forward block motion vector to generate a 
global motion signal, a step (108) where a dominant global 
direction cluster is generated, and a step (110) where the 
generated dominant global direction cluster is used to select 
a potential key frame of the video sequence, and the 
selected, potential key frame is decompressed to extract the 
key frame. 
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<fc?.lf-r*^y •y7fre.*-7b-A£fflffiTS73j£<£> 

ffiistcwr5j!5n0^-r„ *-7i^-Afflm?3ffii o 

OfiXx-yT"! 0 2frP.P*1#!£;ru 
-^*W^$n5 0 Tjffil 0 0«l^<Xx-y7l 0 
4T, TjiSl 0 0tCj;oTJ!ia^5MPEG2<Dffiffie 

x^^y •yT'^ATj-r^o ^ut> Ttrffii ooaxf-y 

710 6 Kit*, kTx** y -y 7"©7'a-/<;l/»jf ffl^ 

y •y7'OAgi5^(07b-A«0/'ci6O^a-^/l/ltlt/^ 
^^{b^TV-'So Ctxeoyp— /</14ft#'<7^— 
^(i, lfx>i-^y>y7 , OiFiJfflpIftg^71x-A«tc/^> 

^.T^So 7v-'WW)Zfsmt. \L?*is->ryx%. 

>X1C 5 >fu-;W® ^ ^7 7 T- 

fe5o cnetO^n-Myl/Sj^fl^^-rSTsffifco 

[00 2 5] Xtv71 0 6<DtS> ?3ffittX7 L -y7'l 0 
8 Kit*, lfr*^-y>'X±ft:»cM-rS7'D-/^H(j 
tOF^^>h73(^(D^-7X^ axT, rKs^->h^ 
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Brett, coxf-^i osoffl. mm*im%&7 u- 

X ±**K TfvVK X-A-TX X-A77K 

figfc7lx-A©K = 7"yh/j[Rj**-7X*<bU fcTx* 
->-y y x£tt<0 V 5 7" y h y D -) WTj ft ^7^i& 

*t) (O^77f$5o 05D#J1.3tfrfr5J:9K. If 

p-A#*t=ofr5&$»K x-A^y^vx*. £/s 
y?7X#lcji#, ^aw^iiih77X*T'$Sfc>5? 

[0 0 2 6] Xfy/l 0 8<D&, /jj&iXx-yXl 1 
So COXr-yXl 1 0CDP& 1 ffl<D^a6^^tl/c^ 

iijco-t y vzm^x kst- y Yfu->\)\,-fjfa>7 7X? 

T> «&{C$3£fcLT*#?>ft5S9<0*-7^A£^ 

^fca^-rso cne.<D*-7^-A*^c7)j;'7{cfflm 

[0 0 2 7] H2£#S8L-t\ 01©*— 7U— 30 

AflbtiiTji^Xx'yXl OGW^XXx-yX©^^ 
Wmc.K<$ a Xt -y 7 1 0 4 T'M P E G If-rtfy-^ y 
XtfA^Snfct, 73&«:Xr>y7 , 2 0 2{cjttyo c© 
Xr-y72 0 2<D^ MP E G 2mfa¥.T*i'->ry7. 
&m<DJiJS.-?®ftmcMm'Zti. (fr*-y-'7-yx© 
±X<0MP E G 2 7n-y h/Wf^ft*,, 

[00 2 8] iftWcM-TSMP EG 2JEf§m>P«, tTx 
* y-^r y X ©SP.3 Wftfitt t B^WTEStt©!^ £S 
ffl-rSt>©T'&£. MPEG2«£*§©^<Ofr©t- 
KSrfUfflL-T^So lOt0*-K«7l^-Art^b 40 

(-ryhv^ft) tmm. tr-r*©£&©iis (pi 

ctures) ttfflSiJtcfr-z>aii{cEiffiXtt^^ft2^§„ 7 
b-Aftfr^fbfi. Bffi©5WcB&&-f SHigR3K*?ft 
•TS^PaWTCfitt^iSfflUT^So 7^-Afl??F*t{b© 
#£ffl^Tft^fb£nfcHffi£ I mtt^. MP 
EGttiiffiP^(O^SW%fitt«:jSfflrS, 7l/-AP^ 

*ffb (-fy*-ft*tfl:) fciWis8ij©t-K%*ijfflL- 

fflM©SS£igBT5o 
[0 0 2 9] MPEG 2«, ^8PJglM£iWx£7U- 50 
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itt 7 U- A©4>© igT? ^D7*P77 ##MS# 

twxtum wtmrn.) 7b-A©fp©s*>gi<«L-/c 

BBI^tl/'c^^oXD-y^tv-y^^n-S,, @i?^a 
7n -y * fr^W* 5u7u-y fWW&iktm? § 

0 7 7, IP^, ^iBiJ-7^a7a-y7<D{4B«:^-r 0 ^© 
(7n«y^) h;MSfgti^{b?ti, Effiiffl® 

7b-Afc#K£a!£4a5„ IHTjlfiJ^fljT'ti, ft^bt 
"<£IM©cp©@g!v^a7a-y^ #Bgfflffitiftf 
*l5j®£<DiIffi<Dcp<£>|p|D-9-'<'X<D 1 II©B&StlfcV 

* a 7n -y tswimRxjmmm&itis&t %> 

(7P7 7) f&£^* <KDgfeT<y^-rS^igiJ 
V*D7n«y*<9&B*^fo l®7jrS)^ilJ£<5gfflL-TM 
P E G 2-m*f{b£ftrcHB*P fcT^* fcPfcR, 

[0030] tfc, mpeg zEmmm^imm^ 

ffl) , 2OO^iijv^D7n-y^(0¥^tc < J:oT^«iJ-r 
§*\ &#i$Bfi (W fr£©^i)r?*a7a-y7ic 

tl, ^(DISSI, 1 v^aXo-y^afcO, a7v2-P(Ol!j 
[003 1] COXf-'yXZ 0 2CQIS, +-7I^-Att 

ai73ffi«ef r ^^-'7-yx^)SJiL, er*y-'7-yx 

c0-r^TOMPEG7a>y^S)t^-?h;l/^f5 o C<0 

?3ffi«-y-<7-yx£5S£cffi^f 5ct&<, coxf 

>y X^P^t 7 U-ABr«*f tfftfrftS C t fi^V> 0 itH 
#fC«, f'<T(D7U-A*^WJca^^n§t>ttT* 

[0 0 3 2] COTjffifi, Xf-y72 0 2T'MPEGtf 
•rsry-^yX^gU^^c^b/c^ Xr-y72 0 4 
tcjitr 0 Xf77 , 2 0 4f«, -f^T<Di£?3fa (70 7 

7) at^^ »*wtc#BBstf/ififiio^fb%fe> 

Sfc-rSd^lS) (7n7 7) S)t^7^;Hc^$n 
5o CftWmfifa (7P7 7) ®Jt^^h;Hi, 

[0033] ^IC, C<D73ftttX-r-y72 0 6tCg?t, 
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d—zWiftt/^*— TGlobal Zooi/Pan estima 
tion and Compensation forvideo Compress ionj (Proc 
ICASSP9K Yi Tong Tse and Richard Bakerg, 2725^ 
-^e>2728-?-^) {cE«£ft/c7ji££&ffl UT7 b 

XKBirSEMSOBaSfc bT, cti&©ya-/W/<9 1C 
^— #*»6 30©ya-/<*ii*OT, X = x (t) . 
Y = y (t) , &l>'Z=z (t) *<»jSSn*. 

5C(C*SftT^*o 

[00 3 4] 05A£#B8bT, W*Wft£7** 

fl#x (t) ©y77^t, 7j<¥Sll{i7U-AS^0 
*^e>7 b-AS*t 2 6 0 $T'CDlf7 ? ^'>-'7-yX©7 b 
-A©R**bT^*. SRW4-1 0B**»6 + 2O 

-*x#- 1 0fr5 + 1 OSTttHRfc'hSft'OIMft 
fcjjVf CttffrfrSo 1 OSrigx^^/^^-^xte 

&rty®9h*7HT 0 - 1 o*8i©><y><7*— * x«e 

XOH*. Rte7b-Z»#*§ 1 3 Ofrfc 2 3 0 St'fiS 

[0 0 3 5] H5B*RJ»bT\ 0 5AT<£ffl£ 

h) £l««nfcyn-/</H&*fI9y (t) (0^77* 
TBfo 0 5 A i:BMlC» jJcTWlB? b-AS# 0 6 7 3 
b-A#!§2 6 0 $T*<Dt£ 7 ? *>'-'7->X<D7 
R£gbT^S„ Sfi||fct4-2 0'BJR*»6+2 0iB** 

Bt±^A/heW«*f. -10*lC/^7^-^y 
(4"F*/H*fc»*ji*r. H*»6fo*r*<fc5fc, ^f*^ 
— fryjWMW, «Ma7b-A#*§6 0, 1 2 5, 1 5 
0, 160, 220, Rlf2 4 0(4SV^;I/h^flre£ 

[0 0 3 6] 05C£#BBbT, @5AT'(Iffl£ 
ftTI/>SOi:R|Uff!I^W*trf f *>'-^>X(D (X- 
A) £«Stifcyn-/</HMrfi*z (t) <97*77£ 
ST. H5AfcH«»c» 7k¥fftf47U-AS^0A^7 
V-L.&^ 2 6 0 £T-<7)tf 7-7" 7X07 b-2»<D 
R«ftLTlf^«. SEHft{40X-A^S*^ 1. 2X- 

/»fla»*-csftr*x-ix^7^-*zT*s. x-a 

* z tfo. 9 8H1. 0 2*T?ttHftfc/Jv£ 

*x-A8»**rc i. 0 2*iksx 
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OX-i»/<7^-*z«X-A^>»»%Sr. Hft»6 

t>*^<t9«c, tf-rr->-'7-yx<Dfg(K «fe7U-A 

0*">P> 1 4 OST'WX-A-ry^lljT'feSo 
[0 0 3 7] ^t, 03*#SaLT, 01K*bfc7j*£ 
<DXx-v7l 0 8<W7Xx7 7©^ftS£PSffl£* 
r. *-7b-Attai73ffif4X7 L -y72 0 6T*ya-A 
;Mft*R9*JI«bfcR,. X-r-y7 > 3 0 2tCitCy. x-f 
•y73 0 2©HU ?n— /VWflre4>&4<!)|M* 

«Ars 0 ep^, *-7b-A«im?jiit4, «jsnji£& 

&7b-A©&ya-Art//^;<-*£30<Dg|&'7'P 

-/vw<7*—*fi+ k o, -ioioic^r§o 

yn-/W/*>/<9>*-*x©W&fc, - io 
Sx<+ 1 OT'&tttfxtfOtC^&StlSo £*>&ttft 
f4\ x> 1 OT'fcntf xtflfc£&£tU x<-10T' 

-*z<Di§£K, 0. 98£z£l. 0 2?*ft«f z# 
OKg&SftSo £6&f*tl& z<0. 9 8T'*ntf 

z#-i tcg«*n, z>i. 0 2T*^ntf ztf+ic 

[0 0 3 8] ■B«**Ar*X"ry7*3 0 2 0%, Xx 
773 0 4fcji*, Stg(^n-/^HIitM^e7i'X 

D-z^mse^fe/^XifeBSf^r*, c©&&{4, 
(Dfe^^s^-zi/^wr^o jg«*§s$ag<Dg#sjft£ 

IfiWL/'c TFundamentals of Digital image Processin 
gj (A.K.Jaittg, 384^-7) *RfiR*tlfcV\, CCQ?j 
iit4, Xf773 0 4co&, Xx-y73 0 6lcjtty<> 
[0 0 3 9] C<D*-7U-Afftm7a)*t4, Xry7*3 
0 6cDfQ, e-r*S/— JrVX^ftlCttoTy-fXftHKa 
SftfclHiiS^o-/ Wftf ffi^cS-3^T H 57"7 h y 
P-/W£fa*5X**£j«r*. C<7y73ffit4, fUfflRj 

\y-h(D^a-f^vm^m<o hTJifij^fj^r 

§„ 7U-A©K5-7-yh73lol{4, fc/^X €^7, ± 
Tf*h, X-A-Y7, X-A77K, 7*P- 
/W±(D{5ftl^T'«>5o ^LT, r^TOfUfflBI^ 
7b-A©K5-f7h73(Sj«-i'7X^{kL, e-rr-7- 
^ 7X±f*c0 K S 7 h 9 P— ' ^W73 (SJ 777? £Jg/£ 
r?>o fi«Jxff, rya-/<;M»jhJ m)&i3* ; 7®±Jk 
aVXt4'h^*D-*^r 7-7x7 h^S), iP^-lfPfc 
jfii/^X«-fe*a^^l-''^07U-Alcwr?>r'<T© 

J4, 7 U-A«0giail7"n-M;l/»i$ffl{i (/S7=l, X 
-A=0, 7 t ;l'b = 0) -CSSo UPL£tfe>, 7b- 

A»cMtTffl^t>^nfci!)^*^ar5^ (^^. 
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= 0) . ?u->WW8l<OYS.i- yh/jfali, Xf^ 

2 o 6T'gm*nrc3ocDa^<o^p-/^n)i#{i^(o 

7 U-A+cO«*©«ffl©yp-A7l/f!jt<s^£^J;£^ 

®mt5o 05A^P>0 5ClciS^tl?.<t9tc, X-A 
S v i- - * (i, f^hyD-^l//^^-^ 
Wyyu-tKWz*-* tim&5* h U -y 

X-A^D-M;Hdtffl^(i, *;UHfa-/W 10 

&J£8 LT y a-/ WHM) K = y h »ra*WJ£T?« 

[0 0 4 0] #(C, H5D*#BaUT» 0 5AT'iIffl£ 20 
tltVS© £ |BJ UffH^Wfc If 7* * >— ^ >X<DB#flfl<DW 

71/— Af&*§) 0^77*it, E^-r§J:9tC^ 7U 
-AS^OfrM 0 f ffO^a-A^iti'yX^ *^ 

Ofrfc 1 3 OORSfcX-A'l'y^X^tf&So C(DB# 
HI4><0 K5-t> h yn-/W*MttX-Z»-< VT** g 
X-LJyt7X*<D'&, 7l/-A#«§ 1 3 0A>62 3 

7U-AS#2 3 0^5>2 6 0ST*<oyp-^;l/ 

[00 4 1] ^IC, 05 AA">£@5 CtCTjkLtc&vK., 
7U-A## 1 3 0fr£ 1 4 0 *TO>WIIBlCiE'<>»» 
fcX-A^>^fc#S*9£oTV**Cfc#tofr*. 

n-/^WBB*&/<yT?**fc!p*£-r*. «fe7U-A 
#*|6 0, 1 2 5, 1 5 0, 1 6 0, 2 2 0T*<D ; f;H- 40 

>Mi5S<, +-7b-Attth73ffi«^7X^<b<DHC 

[0 0 4 2] H4*#JHLT, 01O^-7U- 

AfflUJ7ji£<*>Xx-y7'l 1 0©t7Xf-7 T'OSMaH* 
jjVfo Xx>y7'3 0 6T*K2-?-yh7"P— WH^*? 1 ? 
X**WJ£bfc«L COTjffifctXx-yTM 0 2lCfflty, 
C(OXr-y7'4 0 2^83, KS7-> h7*P-M/l/7j|6]* 

vxzfr^m&mtt-y^-htfmiznzo cne 50 
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*-7l^-A«, CcOgpgT'MP EGEiffilf-r^*^tt 

m$n?>ct«^v\ cne>+-7u-A«, wtos 

[0 0 4 3] •^>'X(if-;l/htf)fi$&t;SJSlc<toT 
/^^^X^Xa^l/h^^X^cD/cfelC 1 
©7b-A%iIiR-f5o 

[0 0 4 4] • X-A^RtfX-AOfi^tCioTX 
-A*7X*<0fci6fc 10X««&<D7^-A;S:iil^R-r 
?> 0 

[0 0 4 5] -SyD-M;H|±<77X^<D/c:4!)lC lO 
<D7b-A(D*^iR-r§c 

[0 0 4 6] «*tf , ^y^7X^*^S«?^tl5)§li 
W**-7U-AM\ /Si/^X^cQftSRtfjIfilCj: 

oT/<yoiww», &tf'<>iB7V#fc 

[004 7] ^1C, 05D1CMO, 05A*^05C1C 

^$n5ef f ^y-yyxco/c:it)fcs^$n/'c?SttW% 

/M!l±77X*<Dfc*Mc§liR2ft5 1 oo+-7l/- 
A, X-H>?77>$<Dffl!£RZf!&7T'X-h'(y!? 

A, fif£<97*P->'W/g$it?7X*<Dfc&lca&£tl3 
1 ■OCD*-7l'-A^-5o 

[0 0 4 8] Xr yX4 0 2©&, C<073)4«X-r >y 7 
4 0 4{CjiCyo X-r-y 7*4 0 4T'(i> Xfy74 0 2T' 
StRSftfc*-7b-A<D7Lft&*-7U-Atf¥R<0 

[0 0 4 9] • r-yp-/^;l/^±j T'K^t^XtKDffl 
<f&/H7T'S«?^tx5fgaEW^*-7l^-AA^ ryp- 
/<;HI±J ^vX^^lCl^<jb\ CC0+-7U-ACD 

<0*l7T'S»?^n5^lSW^*-7U-A(D^fC ryp 
-/Vl/ilihj ^7X^i<tf, tl<D+-7l/-A?r 

hij^So ryp-^;m±j ^p,s«?n5^-7P 
m?n5*-7u-A<to , t»^ i P n pS ; & ; SL, <mp)CD 

+-7U-A{imittLTV^ 0 
[0 0 5 0] • ^y/?)\'h<Dffl%iT'M1R-$t\Z®G.&l 
^*-7b-A^X-A^vX^O!glC^<^, CO 

+-7b-A*BUi^-rs. CTxtf, rx-A^yj ^7 
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[00 5 1]*L7\ C«D7?fettX7 L -y'/4 0 6tCit 
X7-y74 0 4<D&, 8BT^Sa#?3ft/c*-7 

n, g&5B$r e 3Kiig«&*-7b-Atf£i;3ct&& 10 
n&0iTO**-7i^A*»jBrr* o B^osfiitt* 

MP E Gffi»BflW>D C«HR*afflbTfi«P«aii«* 
a^-rSCfc^TtS. Bft4>3HH1£4>iltl£& DC* 
-7 l^-AB#£^ LTft ? C fc T' # 3 0 
[0 0 5 2] Xf774 0 6©t> COSatt^fy/' 20 
4 0 8fcii#, -y74 0 63b^tlSc«Si:UTSoT^ 
*a*?«*ifc*-7l/— i»*MP E G Kf***'— fr>X 
ft»6S4CWt«. Cti60tt9Stifc«»)+-7U' 
-L.it, MPEGef f *>'-'ir>X<0-9-vy^|tRL, 
Xf7^1 1 2T*m^^tl5 A-Kf-fXi' 
±fce«**iS) o *UT» C<D^rS{iX-r-y7l 1 4 

[0 0 5 3] H5 A*»6H5 CE 

^snsef**^- >-y^©fc«>Kttai«*ifc*-7U 30 

-WWWSt X7 -y74 0 4<Dffl, 5<fc9t 

aa«nfc*-7 j^suawsuw©* -y 

h£ffil>T!g2. 31 4, Rtf»5 0»att**-7U- 

C:<D0iJfCfe^5HiJf»X-r«y74O6 
tt, ra«*^7l/-Z»fc«9fiSft**-7l/-2»fc 
Jlofrft-f » «tfJS*ifc*-7 U-^ttHS© J: 9 K» 
2ft§ 0 *UT» £<0?jffi«:C*l5<0*4tlJ;**lfc*-7 

[0 0 5 4] b^*aS««a +-7U-A 40 

t!a-?^XrA6 0 OfctefflLTHSSt- 5C £Wf« 
CCX\ @6©7a-feXtt3>'kfa-^i/Xri, 
6 0 0O(pT'^tT-r577U >3 >7a^7^%if 

%fflttir5^}S<0Xr-y7a, ny^a-^tcioTH 

HfiS^nS. CC0V7b7x7{i, *-7U-AttHl73 
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05Iffi^j«f*E|B1i^nTfeat\ C<DV7h7x7 
Afl'EBS titz n > if a - * 0 nTflEttttfta 3 y 

%m(onmBmc&KT*—7 u-L.%mm%mi% 
mmttmmt « c t $ t \.\ 

[00 5 5] n>kfi-^->Xf-i»6 0 Oti, a>kTa 
-«->V*60K *-tf-K6 0 2&tfT7X6 
0 3 <*><}: -p&A^B, 7'Jy*6 1 5£^tyW*lg« 
&tfg^&B6 1 4^filxT^>5o ^aiS (tfA) h 
7yi/-MS@6 1 6tf, 0M.tf«&|ElIft6 2 1 X&Z 
c0fBl(D«J6ji»^UTS!KRlffi*fflM*'J' H7-* 6 

2 o top^T'fflffl-rs/ctoicnyea-^^r^a-^e 

0 1 lcj;oTl£ffi£tt5o CO^fAe 1 6«, -fy* 
-*<yK RtfP-*;I/X«J7*y h7-f (LAN) 
Jf>7^ KxD7*y h7—> (WAN) ft£fft£>*>yh 
7- * ->X7A'\<07 *-trX£?#5 fta6tiH£ffl £*i5 0 
[0 0 5 6] nyifa-^t^-^eoiiilf, '> 
&< fcf> Ioco7a-b-y9-a^>y h60 5, WxJf¥» 

<*7y?i,7^-bx^t'; (ram) ^mfrmomm* 

(ROM) T'^/?£^nfc^^Ua^-y h6 0 6, kT 
f^-fy?7i-X6 0 7 £r#£rAtiJ7l (I/O) -f > 
*7x-X, *-tf-F6 0 2&O*-?7X6 0 3&tf# 
7->3>©-7a-fX-f- (BEvS?) fflcDAtiJTK 
y*7x-X6 i 3. Mmc^-ri^ 1 6ffi<7My£7 
x-X6 0 8£$t? o I21t^B6 0 9*WP>tl, CO 
SB«am, /\-Kr-fX^K'7-<76 1 0&O*7n-y 
If-r — tVX?K7^76 1 l£^ty 0 ffl^r- 

7K7W7 (0/ive-f) ^ffl-rscttT-ts. ifif 

%ttx-^iSi:tTii#> C D-ROM K7^7XtiD 
VDF7-r76 1 2*W6tiTV>So nylfx-**- 
7a-;l/6 0 1 0«lfi!tS^6 0 5-6 1 3irMft, *B5 
M?tlft/U6 0 4^UT, MSS'#tCfc^5cn 
5Dfc]<7)ni/tfa-£->X-fA6 0 0O«3taa<0»fft 

T'tSa>trx-^<7)^JE(i, IBM-PCS tfaWT" 
;k Sun SparcstationXfi^tl^A^iHtt/clSHi^n 

ytfx-^i/XxAA^tn^o 
[00 5 7] ffl«» «P*U^3feM0e«©7yj^—>3 
V7ny7i*ti> n-Kf-<X7K7^76 1 0±fc# 
ffib^ 7D-fe y-9"6 0 5kl<fcoT^7£tl5|gfc§f#$ 

^'J6 0 6^ ^tCtoTtiM-Hx^X^ H9^7 
6 1 0 t*HC®mLTfit>t\5o ^<-Dfr<omT'l,i. 7 
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yjy—>3>yayvAtt, CD-R0MXIi7P7 

fctZ Kv>f7*6 1 2X«6 1 1 &ftlTft*K*ft\ 
ogvHia— Iffci-pT^xASBe 1 6*y>tT^-y h 
7-*6 2 0fr'E>S?#-&£*lTfc&<,\> MtC. V7h7 

a-**ri?a-;I/6 0 1 Rtffl&OgB©^^^^ 
-^^^Xli^n^e^+^^K PCMC1 A*-K4 

eootca-K^txTfeav^o ±a?Lfct>^«, wa-r 
ftwvmm&zfm % * b w&x tc m<D a y e a - * w 

[0 0 5 8] Jlc7)3ytra-^'>X-rA6 OOti, 

#*EW*«B*«rr«. 7 f *7 f -*« DVD-R 
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